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Abstract 

This paper considers robust stability analysis of a 
large network of interconnected uncertain systems. To 
avoid analyzing the entire network as a single large, 
lumped system, we model the network interconnections 
with integral quadratic constraints. This approach 
yields a sparse linear matrix inequality which can be 
decomposed into a set of smaller, coupled linear ma- 
trix inequalities. This allows us to solve the analysis 
problem efficiently and in a distributed manner. We 
also show that the decomposed problem is equivalent 
to the original robustness analysis problem, and hence 
our method does not introduce additional conservative- 



1. Introduction 

Robust stability analysis with integral quadratic 
constraints (IQCs) provides a unified framework for 
analysis of uncertain systems with different kinds of 
uncertainties 0]. The main computational burden in 
IQC analysis lies in the solution of a semi-infinite lin- 
ear matrix inequality (LMI) which is generally dense. 
One method for solving this semi-infinite LMI makes 
use of the KYP lemma to reformulate the frequency- 
dependent semi-infinite LMI as a single frequency- 
independent LMI. However, this reformulation yields 
a dense LMI, and hence the computational cost is high 
for large systems even if the underlying structure is ex- 
ploited as in El S |U H El |9] HO). The semi- 
infinite LMI can also be solved approximately by dis- 
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cretizing the frequency variable to obtain a finite num- 
ber of LMIs. The resulting LMIs are generally dense, 
and as a consequence, IQC analysis of large-scale sys- 
tems is prohibitively expensive in most cases. 

In this paper, we consider IQC-based robustness 
analysis of a large network of interconnected uncer- 
tain systems. We show that by representing the net- 
work interconnections as quadratic constraints, we ob- 
tain a semi-infinite LMI that is sparse. Reformulating 
this LMI using the KYP lemma destroys sparsity, but 
discretizing the frequency variable does not, and hence 
we limit our attention to frequency-gridding methods. 
We can exploit sparsity in each LMI in different ways: 
(i) we can use an SDP solver that exploits sparsity 
ifTTl [121 13, or (ii) we can use chordal decomposition 
methods to split a sparse LMI into a set of smaller, 
coupled LMIs JT] Q~3). The first method solves the 
robustness analysis problem in a centralized manner, 
and hence it requires complete information about all 
the subsystems in the network. The decomposition ap- 
proach, on the other hand, allows us to solve the robust- 
ness analysis problem in a distributed manner where a 
small cluster of subsystems only communicates with its 
neighboring clusters in the network. 

1.1. Related Work 

Control and robustness analysis of interconnected 
systems is an active area of research that has been con- 
sidered in several papers in the past few decades; see 
e.g. flU E] US [nl Ha. Different methods for ro- 
bustness analysis have been developed, e.g., jj. analy- 
sis and IQC analysis H3 [20] E0 [2 E2. 
analysis tools are effective for small and medium-sized 
interconnected systems, they fail to produce results for 
large-scale interconnected systems because of the high 
computational cost. To address this issue, ll23l and ll24ll 
propose an efficient method for robust stability anal- 
ysis of interconnected uncertain systems with an in- 
terconnection matrix that is normal, and |[T8l consid- 
ers stability analysis and design methods for networks 
of certain systems with uncertain interconnections. A 
similar problem is also considered in [25|. In |26|, 



the authors consider robust stability analysis of inter- 
connected uncertain systems using IQC -based analysis, 
and they show that when the interconnection matrix is 
unitarily diagonalizable, the analysis problem can be 
decomposed into smaller problems that are easier to 
solve. Finally, [27 1 shows that by using Nyquist-like 
conditions and by considering the dynamics of individ- 
ual subsystems and their neighbors, it is possible to re- 
lax the interconnection constraints and arrive at scal- 
able analysis conditions for interconnected uncertain 
systems. 

1.2. Outline 

The paper is organized as follows. In Section [2] 
we present an integral quadratic constraint for intercon- 
nected uncertain systems, and we show how this can be 
used to obtain a sparse analysis problem. In Section [3] 
we show how the sparse analysis problem can be de- 
composed into smaller, coupled problems, and we dis- 
cuss how the analysis problem can be solved distribut- 
edly. Finally, we conclude the paper in Section0 

1.3. Notation 

We denote with R the set of real numbers and with 
M mx " the set of real m x n matrices. The transpose and 
conjugate transpose of a matrix G are denoted by G T 
and G*, respectively. Given matrices G', i = 1, . . . ,N, 
diag(G 1 , . . . , G ) denotes a block diagonal matrix with 
blocks G'. Similarly, given a set of vectors vi,... ,Vn, 
the column vector (vi, . . . , v^) is obtained by stacking 
these. The matrix inequality G >- H (G >; H) means that 
G — H is positive (semi)definite. We denote with the 
set of square integrable signals, and ^tfjtf'oo represents 
the set of real, rational transfer functions with no poles 
in the closed right half plane. 
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This can also be written in frequency domain as 



JU®) 
A(?)0'<»). 



nc/o) 



Ate) CM 



dco > 0, (2) 



where q and A{q) are Fourier transforms of the sig- 
nals q and A(q), respectively, and H(ja>) — n(j©)* is 
a transfer function matrix. 

IQCs can be used to describe different classes of 
operators and hence different uncertainty sets, e.g., op- 
erators with bounded gain, sector bounded uncertainty, 
and static nonlinearities [ 1 ]. We now consider a system 
described by the equations 



p = Gq, 
q = A(p), 



(3a) 
(3b) 



where G 6 &J$?™ xm is a transfer function matrix and 
A represents the uncertainty in the system. Recall that 
A is bounded and causal. Robust stability of the system 
(0 can be established using the following theorem. 

Theorem 1 (|1, 22 1) The uncertain system in (0 is ro- 
bustly stable, if 

1. for all X G [0, 1] the interconnection described in 
(0, with tA, is well-posed. 

2. for all T G [0, 1], tA G IQC(II). 

3. there exists £ > such that 
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2. Stability Analysis of Interconnected Sys- 
tems 

We begin this section with a brief review of some 
key results from IQC analysis. 

2.1. IQC Analysis 

Let A : M. d — > M. cl be a bounded and causal opera- 
tor. The mapping q = A(p) can be characterized using 
integral quadratic constraints defined as follow. 

Definition 1 (IH1 I22I ) Let Yl be a bounded, self-adjoint 
operator. The operator A is said to satisfy the IQC de- 



It follows from Theorem [T] that, given a multi- 
plier n, IQC analysis requires the solution of the semi- 
infinite LMI (01. As mentioned in the introduction, 
we consider an approximate solution to the IQC anal- 
ysis problem where the feasibility of the LMI in (01 is 
checked only for a finite number of frequency points. 
We will see later in this section that this allows us to re- 
formulate the robust stability problem as a sparse LMI 
when the system of interest is a network of uncertain 
interconnected systems. 

Remark 1 (122, 26 1) Suppose A' G IQC (IT) where 
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Figure 1. The ith uncertain subsystem with Fjgure 2 . Compact representation of the net- 
structured uncertainty. work of interconnected systems. 



The block-diagonal operator diag(A' , 
isfies the IQC defined by 
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where Fly = diag(n^ 

2.2. Network of Uncertain Systems 

Consider a network of N uncertain subsystems of 
the form 



G'q' 



z' = G' zq q' + G' zw w' 
9<=AV), 
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where G' pq G @Jg"t Xdi , G' pw £ ^Jf**" 1 *, G\ q e 
2%Jtf t xdi , Gi K G ^jri xm ', and A'' : W 1 ' -> W 1 '. The 
ith subsystem is shown in Fig.[T] The network intercon- 
nections are defined by the equation 











w 2 









Hi 
r 2 i 




(8) 



where the z'j'th block r i; is a 0-1 matrix that defines 
the connections from system /' to system i, and w = 
(w ,...,w") and z = (z 1 , . . . ,2^) are the stacked in- 
puts and outputs, respectively. Similarly, we define 
q = {q , ... ,q N ) and p = (p ,. . . ,p N )- Using the inter- 
connection matrix, the entire system can be expressed 
as 



P — G pq q -r\jp w 



G 

Z = G zq q + G 
9 = A(p) 
w = Fz, 



w 
w 
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(9b) 
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where the matrices G Wj , G pw , G zq , and G zw are block- 
diagonal and of the form Gy = diag(G^-, . . . ,G^), and 
A = diag(A ! , . . . , A^) is block-diagonal. The full system 
is shown in Fig. [2] One approach to robustness analysis 
of interconnected systems of the form (0 is to elimi- 
nate w and z from the system equations. This yields the 
lumped system 



where 



p = Gq, 
q = A(p), 

G = G pq + G pK (I — FG ZW 



(10a) 
(10b) 
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is the lumped system matrix. Note that the matrix 
/ — rG ZM , must have a bounded inverse for all frequen- 
cies in order for the interconnection to be well-posed. 
The lumped system matrix G is unfortunately dense in 
general, even if the matrix / — rG ZH is sparse. This fol- 
lows from the Cayley-Hamilton theorem. As a result, 
IQC analysis based on the lumped system description 
( [Tol l is prohibitively expensive for large networks of un- 
certain systems. 

2.3. IQCs for Interconnections 

Robust stability of the interconnected uncertain 
system (0 can be investigated using the IQC frame- 
work. To this end, we now define an IQC for the in- 
terconnection equation w = Fz- The equation w = Fz 
can be expressed as the following quadratic constraint 



-\\ w -r z \\i = - 



X[-F I] 



>o 
(11) 



where || • \\x denotes the norm induced by the inner 
product (a,Xj3) for some X >~ of order m = Ylt=\ m >- 
As a result, we can define an IQC for the interconnec- 
tions using the following multiplier 

~-F T XF F T X 
XF -X 



n 



(12) 



where X is positive definite. Note that the framework 
described in this paper can be extended to incorporate 
dynamic and/or uncertain interconnections by defining 
suitable IQCs for such interconnections. 

We now show that the IQC analysis problem can 
be expressed as a sparse LMI by using ([T2l to model 
the interconnections. Consider the interconnected un- 
certain system defined in ||9), and suppose that 

A' e IQC (IT), i=l,...,N 

such that A e IQC(ff) where II is defined in ©. We 
will henceforth assume that A satisfies conditions 1 and 
2 in Theorem Q] Then, by Remark Q] the network of 
uncertain systems is robustly stable if there exists II and 
X y such that 
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for e > and for all co £ [0,°°]. This can also be written 

as 
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or equivalently, as 
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The following theorem establishes the equivalence be- 
tween robustness analysis of the lumped system ( TTOb via 
© and robustness analysis of (0 via (fT3T >. 



Theorem 2 The LMI (TT5T > is feasible if and only if 
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is feasible. 



proof. We start by applying a congruence transforma- 
tion A i->- T*AT to the left-hand side of (15[ where T is 
nonsingular and defined as 
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The result is a 2-by-2 block matrix 
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where Gn is defined as in ( fTBT l, and 
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Since G is homogeneous in ff and X, it follows that (fTBI l 
is equivalent to G -< 0. Now if ( fTol l is feasible, then (fT5l l 
is feasible if 



5 = G22 — G21G, j G 2 i -< 0. 



(18) 



Since (7 — TG ZW ) is nonsingular for any ff such that 
Gn ~< 0, we can scale X >- so that 5 -< 0. Conversely, 
if (TT5T > is feasible, then Gn -< and hence we can scale 
ff and X so that Gn ^ -el. ■ 

Theorem [2] implies that our approach does not in- 
troduce conservativeness. However, the LMI ( Tl3T > is 
generally dense if the matrix X is dense. We have the 
following corollary to Theorem[2] 

Corollary 1 In H5i . it is sufficient to consider a diag- 
onal scaling matrix of the form X — xl with x > 0. 

proof. Suppose ff is feasible in ( fTST ). Then we can 
choose X = xl with x > such that the Schur comple- 
ment S in ( fT8b is negative definite. ■ 

Corollary [T]implies that we can choose X to be any 
positive diagonal matrix. This mean that the LMI ( fl~5T > 
becomes sparse when the interconnection matrix T is 
sufficiently sparse. In the next section, we discuss how 
we can solve (15[ efficiently when the LMI is sparse. 

3. Decomposing The Analysis Problem 

In networks where each subsystem is connected 
only to a small number of neighboring subsystems, the 
LMI (Tl3T > is generally quite sparse. As mentioned in the 
introduction, we can solve the LMI (TT3T > in a centralized 
manner using a sparse SDP solver such as DSDP, or 
alternatively, we can make use of decomposition tech- 
niques to facilitate parallel and/or distributed computa- 
tion. In this section, we discuss chordal decomposition, 
and we show how this decomposition can be used to 
formulate an efficient distributed algorithm for robust 
stability analysis. 



3.1. Chordal Decomposition 

Chordal sparsity plays a fundamental role in many 
sparse matrix algorithms [28 1. We say that a matrix is 
chordal if the corresponding sparsity graph is chordal, 
and a graph is called chordal if all its cycles of length 
at least four have a chord; see e.g. [29 , Ch. 4]. A clique 
is a maximal set of vertices that induce a complete sub- 
graph. The cliques of the sparsity graph correspond to 
the maximal dense principal submatrices in the matrix. 
We will use the following result from [ 30 1 to decompose 
the LMI O- 

Theorem 3 (Agler et al. [30 1) Let A be negative 
semidefinite and chordal with cliques Ji,J 2 ,...,Jl- 
Then there exists a decomposition 

L 

A=£A,-, i=l,...,L (19) 

i=i 

such that \Ai\jk — for all (j,k) ^ Ji x 
proof. See (30) and E). ■ 

Remark 2 It is also possible to apply Theorem [3] to 
negative semidefinite matrices with nonchordal sparsity 
by using a so-called chordal embedding. A chordal em- 
bedding can be computed efficiently with symbolic fac- 
torization techniques; see e.g. H32V . 

A band matrix is an example of a chordal matrix, 
i.e., if A has half-bandwidth w, then 

A jk = Q, \j-k\>w, 

and the cliques of the corresponding sparsity graph are 
given by the sets 

Ji — {i,i+ 1, . . . ,2 + w}, i=l,...,n — w, 

where n is the order of A. 

The cliques of a chordal graph can be represented 
using a clique tree which is a maximum-weight span- 
ning tree of a weighted clique intersection graph; refer 
to [28 1 for further details. The clique tree can be used 
to parameterize all possible clique-based splittings of 
A. For example, consider an irreducible chordal matrix 
A ^ with two cliques J\ and J2, and let A = A\ + A 2 
be an any clique-based splitting of A such that [A,-] = 
for all (j,k) Ji x 7,. Then, by TheoremfJ] there exists 
a symmetric matrix Z that satisfies 

Zj = o, (i.,j)^(Jinj 2 )x(j 1 nj 2 ) 

such that 

Ai =A~i+Z^0, A 2 =A 2 -Z^0. 



It is easy to verify that the matrices A\ and A2 sat- 
isfy ( fT9l ). We can use this decomposition technique 
to parameterize all possible splittings of the LMI < fT3T ). 
Suppose ( fl~5T > is irreducible and chordal with cliques 
J\,...,Jl- Then if we choose X = xl, we can split < Tl~5b 
as 

A X +A 2 + ---+A L (20) 

such that the matrices Ai , . . . ,Al share only the variable 
x, and [Aj]jic = for all (j,k) £ Ji x This means that 
(15[ is equivalent to L coupled LMIs 

Ai + Z Pii - £ Zy:<0, i = l,...,L (21) 

;ech(i) 

where pi is the parent of the /th clique in the clique tree 
and ch(/) is the set of children of clique i. The matrix 
Zij couples cliques i and j, and it satisfies 

[Zij] kl = o, (k,i)^(JinJj)x{JinJj). 

Note that the term Z Pi i in (f2Tb disappears if clique i is 
the root of the clique tree, and the summation over the 
children of clique i disappears if i is a leaf clique. Fur- 
thermore, note that the sum of the left-hand sides of the 
LMIs in (EB is equal to < f20t . 

3.2. Distributed Algorithm 

The set of LMIs (fSTJ can be expressed as 
Aj + Z pii - £ Zij < 0, i = 1, . . . ,L (22a) 

;ech(/) 

x k =x,,Z k i=Z kh y{k,l)e^ (22b) 

where Z Pj j is the copy of Z Pj j associated with clique i, x; 
is the copy of x associated with clique i, and (k, I) € ST 
means that (k,l) is an edge in the clique tree 3T. The 
coupling between the LMIs (I22al > is now described as a 
set of equality constraints ( |22b| i. Fig.[3]shows a subtree 
of the clique tree with the auxiliary variables associated 
with the subtree. The formulation d22b is a convex 
feasibility problem of the form 

find x,si,s 2 ,...,s L 
subject to si e %, i = 1, . . . ,L (23) 
Si=Hi(z), i = l,...,L 

where ^1 , . . . , % are convex sets, s\ , . . . , Sl are lo- 
cal variables, and the constraints s, = ffj(z) ensure 
global consensus. The problem (|23l can be solved 
distributedly using e.g. the alternating projection (AP) 
method, Dykstra's AP method, or the alternating direc- 
tion method of multipliers ll33l . 








Figure 3. Subtree of clique tree: clique i, its 
parent, and its children. 




Figure 4. A chain of N uncertain system. 



3.3. Example: Chain of Uncertain Systems 

We now consider as an example a chain of N un- 
certain systems where each system G'(s) is defined as 
in (0 with scalar uncertainties 8 l .... , 8 N . Fig.|4]shows 
the chain of uncertain systems. 

The inputs and outputs are defined as w,- = (wj , wf) 
and Zi = (zj,zf) for i — 2, ...,N— 1, and moreover, 
w\ — wf, wn = wjf, Z\ — z\, and z, 
connections are described by the equations wj 



zjf. The inter- 



and wf — zj +l for 



- H-\ 

1, and w\ = z\ and 



,2 

Z N-1' 



2,...,N 

We assume that the signals wj and zj 
are scalar-valued. As a result, the interconnection ma- 
trix r that describes this network has nonzero blocks 
r, ,_i = n_j ; for i — 2,...,N, and these blocks are 
given by 



r u-i = r i-U = 



1 




i = 3,...,N-l, (24) 



20 40 60 80 100 120 140 „0 20 40 60 80 100 120 140 




(a) Before reordering. 



(b) After reordering. 



and 



Figure 5. Sparsity pattern associated with (Q3]i 
for a chain of 50 systems. 



LMI ( fTBT l can therefore be decomposed into 2N — 2 cou- 
pled LMIs of order at most 4. The sparsity pattern as- 
sociated with ( fT3T > for a chain of 50 uncertain systems 
is shown in Fig. [5] In this example, it is also possible 
to combine overlapping cliques such that we get a total 
of N cliques of order at most 5, and in general, there is 
a trade-off between the number of cliques and the order 
of the cliques. Note that analyzing the lumped system 
yields an LMI ( fTol l of order N whereas the sparse LMI 
( fTBT l is of order 3N — 2. For large networks, solving 
the sparse LMI can be much faster, but for small and 
medium- sized networks, the original dense LMI ( TT6b 
may be cheaper to solve. 

4. Conclusions 

IQC-based robustness analysis of a large network 
of interconnected systems involves the solution of a 
large, dense LMI. By expressing the network intercon- 
nections in terms of IQCs, we have shown that it is 
possible to express the robustness analysis problem as 
a sparse LMI that can be decomposed into a set of 
smaller but coupled LMIs. The decomposed problem 
can be solved using distributed computations, and we 
have shown that it is equivalent to the original problem. 
These findings suggest that our method is applicable to 
robustness analysis of large networks of interconnected 
uncertain systems, but further work needs to be done to 
establish what types of network structure yield compu- 
tationally efficient decompositions. 



r 2 i = r[ 2 = (i,o), r JV _i, JV = r^_ 1 = (o,i). (25) 

In this example, we will assume that the uncertainties 
S 1 ,...,^ are scalar, and moreover, 8 l £ IQC(II;) for 
all i = 1 , . . . , N. If we let X be diagonal, the sparsity pat- 
tern associated with the LMI ( fTBI l is then chordal with 
2N — 2 cliques, and the largest clique is of order 4. The 
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